Just to note, the DAG fails pretty quickly if the UNITY_OUTPUT_DATA_BUCKET ssm path doesn't exist. Should creation of that parameter also be a part of this PR?

After talking with Galen I went with the format /unity/ds/data/bucket/{deployment_name}/{venue}-{counter}/primary-data-bucket (ex /unity/ds/data/bucket/btl/test-b2d6/primary-data-bucket)

Hi Brad, we should probably not merge this PR until the DAG will succeed. I think this involves:

o Making sure the output data bucket exists. Who is creating this, us or DS?
o Also creating the proper SSM parameter

You can work on #2 above, I will raise the question about #1 with the team